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Abstract. Let Gmxn be an m X n real random matrix whose elements are independent and 
identically distributed standard normal random variables, and let /t2(Gmxn) be the 2-norm condition 
number of Gmxn- We prove that, for any m > 2, n > 2 and x > \n — m\ + 1, K.2{Gmxn) satisfies 

(c/x)l"-'"l+i < p( ""''^"■x"' >x] < ^ (C/xjl'^-^l+l . where 0.245 < c < 2.000 and 

5.013 < C < 6.414 are universal positive constants independent of m, n and x. Moreover, for any 
m > 2 and n > 2, i?(log K2(Gmxn)) < log |^_^|^-^ + 2.258. A similar pair of results for complex 
Gaussian random matrices is also established. 

Key words. Condition Number, Eigenvalues, Random Matrices, Singular Values, Wishart 
Distribution. 
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1. Introduction. In f5^, Edelman obtained the limiting distributions and the 
hmiting expected logarithms of the condition numbers of random rectangular matrices 
whose elements are independent and identically distributed standard normal random 
variables. The exact distributions of the condition numbers of 2 x n matrices are also 
given in [5] by Edelman. 

However, in the study of real-number and complex-number error correction codes 
based on random matrices [3J and their applications in fault tolerant high performance 
computing |4j , in order to estimate the numerical stability and reliability of our coding 
schemes, we need to estimate the probabilities that the condition numbers of small 
random rectangular matrices are large. For example, what is the probability that the 
condition number of a 10 x 5 random matrix is larger than 10^? 

In this paper, we investigate the tails of the condition number distributions of ran- 
dom rectangular matrices whose elements are independent and identically distributed 
standard normal real or complex random variables. We establish upper and lower 
bounds for the tails of the condition number distributions of these matrices. Upper 
bounds for the expected logarithms of the condition numbers of these matrices are 
also given. 

Based on our results, for random rectangular matrices whose elements are inde- 
pendent and identically distributed standard normal real or complex random variables, 
we are able to estimate the probabilities that their condition numbers are large. For 
example, based on our results, we are able to tell, for a 10 x 5 real random matrix 
whose elements are independent and identically distributed standard normal random 
variables, the probability that the condition number is larger than 10^ is less than 
6 X 10-^. 

Our main results for the 2-norm condition number k of an m x n real random 
matrix whose elements are independent and identically distributed standard normal 
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random variables are: 



1 ^c\l»-™l+i / K \ 1 

<Pi^. \ -T>2: < 



\/27r Vx/ \n/{\n - m\ + I) J ^/27r \x 

and 

E(log k) < log I + 2.258, 

\n — rn\ + 1 

where 0.245 < c < 2.000 and 5.013 < C < 6.414 are universal positive constants 
independent of m, n and x, and m > 2, n > 2 and x > |n — m| + 1. 

For an m X n complex random matrix whose elements are independent and iden- 
tically distributed standard normal random variables, our main results for the 2-norm 
condition number k are: 

^ .C\2(|n~m| + 1) ^ / ^ \ ^ ^^^2(|„-m| + l) 

2n\x) ^ Vn/(|n- m| + 1) ^ / 27r 



and 



E{log k) < log — - + 2.240, 

\n — m\ + 1 



where 0.319 < c < 2.000 and 5.013 < C < 6.298 are universal positive constants 
independent of m, n and x, and m > 2, n > 2 and x > |n — m| + 1. 

After finishing the manuscript of this paper, we communicated with Edelman and 
learned that similar problem was also being studied independently by Edelman and 
Sutton [7j . After simple formatting, the upper bounds in both papers actually can be 
unified into the same format 

P{k> x) < C{m,n,P) 



where /3 = 1 for real random matrices and (3 = 2 for complex random matrices, and 
C(m, 71,(3) is a function of m,n, and (3. However, the function C{m,n,(3) in the two 
papers do take very different forms and imply very different meanings. 

On one hand, the bounds in [7] are asymptotically tight as a; oo while the 
bounds in this paper are not. On the other hand, the bounds in this paper involve 
only elementary functions. Hence they are much simpler than the asymptotically 
tight bounds in [7] which involve high order moments of the largest eigenvalues of 
Wishart matrices. Although for the special case of large square random matrices, 
simple estimations for C(m, n, (3) are given in [7], for general rectangular matrices, no 
simple estimation is available. 

It is well-known that the joint eigenvalue density function of a Wishart matrix 
has a closed form expression [9]. Therefore, P {k > x) can actually be expressed 
accurately as a high dimensional integration of this joint eigenvalue density function. 
One of the key aspects to estimate P {k > x) is to find a simple-to-use estimation of 
this accurate (but not simplc-to-use) high dimensional integral expression. This paper 
is meaningful in that it finds out such a simple-to-use estimation by giving out simple 
upper and lower bounds which involve only elementary functions. We refer interested 
readers to [7] for more accurate asymptotically tight bounds and other related bounds 
for the tails of the condition numbers of general /3-Laguerre ensembles. 

Above and in what follows in this paper, the constant C and c denote univer- 
sal positive constants independent of m, n and x; however, identical symbols may 
represent different numbers in different place. 
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2. Preliminaries and basic facts. Let X be an m x n matrix. If cti > 0-2 > 
... > (Tp, where p — min{m,n}, are the p singular values of X, then the 2-norm 
condition number of X is 

n,iX)^^. 

ap 

For any mxn matrix X, X'^ is an x m matrix and K2{X) = K2{X'^). So, 
without loss of generality, in discussing the condition numbers of random matrices, 
it is enough to only consider random matrices with no more rows than columns. 
Therefore, from now on, when we speak of an m x n matrix, we will assume m < n 
in the rest of this paper. 

Let Gmxn be an rn x n real random matrix whose elements are independent and 
identically distributed standard normal random variables. Let Wm,n denote the mxm 
random matrix GmxnG^xn- Wm,n is the well known Wishart matrix named after 
John Wishart who has first studied its distribution. 

Similar to [5], in this paper, we will study the condition number of Gmxn through 
investigating the eigenvalues of the Wishart matrix Wm,n- The following lemma 
establishes a simple relationship between the condition number of Gmxn and the 
eigenvalues of Wm.n- 

Proposition 2.1. If Xmax is the largest eigenvalue of Wm,n, and Xmin is the 
smallest eigenvalue ofWm,n, then the 2-norm condition number of Gmxn satisfies 



K.2{G 



Xmin 

Remarkably enough, the exact joint probability density function for the m eigen- 
values of the Wishart matrix Wm,n can be written down in a closed form |9|. 

Lemma 2.2. // Ai > ... > A„i are the m eigenvalues of Wm,n, then the joint 
probability density function of Xi > ... > A„j is 

m — 1 rn 



(2.1) /(xi,...,x„) = X,„,„e-*S"i--[]xf(" " n n i^^-^il 
where 



2 

Let N{0, 1) denote the standard normal distribution. Let N{Q, 1) denote the 
distribution of w + iv, where u and v are independent and identically distributed 
A'^(0, 1) random variables, and i = ^/—l. Let Gmxn be an m x n complex random 
matrix whose elements are independent and identically distributed A^(0, 1) random 
variables. Let Wm,n denote the mxm random matrix GmxnGmxn- literature, 
Wm.n is called the complex Wishart matrix. 

Similar to the real case, there is alsoji^simple relationship between the condition 
number of Gmxn and the eigenvalues of Wm,n- 

Proposition 2.3. If Xmax is the largest eigenvalue of Wm,n, o,nd Xmin is the 
smallest eigenvalue of Wm.n, then the 2-norm condition number of Gmxn satisfies 

/ \ / Xmax 

K'2\S-'mxn) — \ — • 
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Like the real case, the exact joiniyarobabihty density function for the m eigenval- 
ues of the complex Wishart matrix Wm n can also be written down in a closed form 

Lemma 2.4. // Ai > ... > Am are the m eigenvalues of Wm,n, then the joint 
probability density function of Xi > ... > A^ is 

m m — 1 ni 

(2.3) /(a;i,...,Xm)=K™,„e-^S"i-' Jl^r™ n U - ^jf, 
where 

m 

(2.4) K-l,^2^-JlT{n-m + i)T{t). 

i=l 

In the process of deriving our upper and lower bounds for the tails of the condition 
number distributions, some bounds for Gamma and incomplete Gamma functions are 
very useful. 

Lemma 2.5. Assume a > 0, and b > 0. If t < -, then 

\ e-''''x''dx <e-''H''+\ 
Jo 

Proof Let f{t) = /J e-'^^x''dx - e-''H''+\ then f'{t) = e-''H''{l + at ~ {b + 1)). 
So f{t) decreases on [0,^] and increases on [^,oo). Since /(O) = 0, and /(oo) = 
e-''''x''dx > 0, if < < ^, then f{t) < 0. Therefore, if i < ^, then e^^^^x^dx < 

Lemma 2.6. Assume a > 0, b > 0, and k > -. If t > -r^, then 

/oo 
e-""x^(ix < fce-"*^^ 

Proof Let f{t) = /^°° e-''^x''dx - ke'^H'', then f'{t) = e-''H''{~l + ka- f). So 
f{t) decreases on [0, -^^] and increases on [^^^^,00). Since /(O) = e^°-'^x^dx > 
0, and /(oo) = 0. So, if t > then f{t) < 0. Therefore, if t < then 

Lemma 2.7. IfT{x) — e~*t^^^dt, where x > 0, then 

(2.5) A/2^x^+^e-=" < r(x + 1) < V2^x-'+h-'-'+^ , 
and 

(2.6) r(x + i) < r(x)v^. 

Proof. (2.5) follows straightforwardly from 6.1.38 in l^i ^'^d (2.6) can be obtained 
from answer to Problem 9.60 in "5*. □ 
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3. Bounds for eigenvalue densities of Wishart matrices. In this section, 

we will prove some bounds for the probability density functions of the eigenvalues of 
Wishart matrices. These bounds are very useful in the derivation of the bounds for 
the tails of the condition number distributions. 

Let Xmax denote the largest eigenvalue of Wm,n, and Xmin denote the smallest 
eigenvalue of Wm,n- In the following lemma, we prove an upper bound for the joint 
probability density function of A 

max and \min • 

Lemma 3.1. Let fx^^^^\^-^{x,y) denote the joint probability density function of 
Xmax and Xmin, then fx^^^,x^i„{x,y) satisfies: 

where 

^^•^^ " 4r (m-l)r(n-m+l)- 

Proof Let Rx,y = {{x2,X3, ...,Xm-i) : x > X2 > ■■■ > Xm-i >y}Q -R"*"^. Prom 
the joint probability density function of the m eigenvalues of Wm,n in Lemma 2.2, we 
have 



hmax,XminiX'y) = / f {x , X2 , ; Xm-1 , y)dX2dX3.. AXm-l 

J Rx,y 

„ m — 1 



(3.3) 

m— 1 rn — 2 m— 1 rn — 1 

{x-y) n ^ Xi){xi -y)W W {xi- Xj) Yl dxi. 

i=2 i=2 j=i+l i=2 

Let Rm-2 = {{x2,X3,...,Xm-i) ■ X2 > ... > Xm-1 > 0}, then Rm-2 C R^^y. Note 
that, in (3.3), x > xt > y for i = 2, 3, m — 1. Replacing x — y and a; — a;, by x, and 
Xi — y hy Xi for i = 2, 3, m — 1, and Rx,y by Rm-2, then we get 

„ ni—1 — 2 7n— 1 m — 1 

(3.4) / e-^ - H ^t—^^) Yl (^, _ a:,) n dx,. 

Note that f{xi,X2, Xm) m (2.1) is a probability density function, therefore, for 
any m < n, we have 



L 



m,— l m 



i=l i=l j=i+l i=l 

where Rm = {xi > X2 > ■■■ > Xm > 0} C i?™. Therefore, we have 

m— 1 m — 2 m— 1 m — 1 



(3.5) / 



e- - n -J^"""^'^ n n (-^ - n = ^-mUn- 



^^-2 i=2 i=2 j=i+l i=2 
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Substitute (3.5) into (3.4), we obtain 

(3.6) /a_,a„.„(^,2/) < ^IIi::^e-^(-+^)a;^("+'"-3)y^(— 1). 

J^m-2,n 

Prom (2.2), we have 

Kr„..n TT 1 



Km-2,n 2"r(n>^)r(f)r(ii-f±i)r(n^) 

(3-7) 



4r(rn-l)r(n-m + l)' 

Substitute (3.6) into (3.5), we get (3.1) and (3.2J_^. □ 

Let Xmax denote the largest eigenvalue of Wm,n, and Xmin denote the smallest 
eigenvalue of Wm.n- Similar to the real case, in the following lemma, we give an 
upper bound for the joint probability density function of Xmax and Xmin- The upper 
bound in complex case can be proved using the same techniques used in the real case. 
Therefore, we omit the^proof and only give the result here. 

Lemma 3.2. Let f~ ~ {x,y) denote the joint probability density function of 

'Xmax and Xmin, ^^^''^ ^XmaxT^min^^'^^ Satisfies: 
where 

(3.9) Cm,, ^ 



22»r(TO - l)r(m)r(n - m + l)r(n - m + 2) ' 



Bounds for the probability density functions of the smallest eigenvalues arc also 
very useful in the derivation of the bounds for the tails of the condition number 
distributions. In the following lemma, we prove upper and lower bounds for the 
probability density function of the smallest eigenvalue of a real Wishart matrix. 

Lemma 3.3. Let f\^i„{x) denotes the probability density function of the smallest 
eigenvalue ofWm.,n, then fx^nini^) satisfies: 

(3.10) L„,„e-^^ari("-'"-i) < /a„.„(x) < L„,„e-i^a;5("-™-i), 

where 



(3.11) 



r(f )r(n-m + l)' 



Proof. Let = {(xi,X2, ■■■,Xm-i) ■ xi > ... > Xm-i > a;} C ^. From the 
joint probability density function of the eigenvalues of Wm,n in Lemma 2.2, we have 



f>^mirv{x)= / f{xi,X2,...,Xm-i,x)dxidx2dx. 

Jrx 



m — 1 



m — 2 m—1 



Yiixi-x)]^ n ~ n 

1=1 i=l j=i-\-l i=l 
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For the lower bound part, taking the transformation Hi = Xi — x, where i 
1, 2, m — 1, we have 

r -1 ™-i 



' Ry 

m—1 m— 2m— 1 m—1 



11^*11 n ~ n 

where Ry = {yi > > ... > Vm-i > 0} C R"'-\ 

Replacing + a; by for z = 1, 2, m — 1, we obtain 

m — 2 m — 1 m — 1 

n n - 2^.') n '^y^- 

Note that 

p m — 1 m — 2m — 1 m — 1 

/ e-^rz y n yt-""^'' n n(y^ - y.) n = kUu^,. 

•^^y 1=1 i=l 1=1 

Therefore, we obtain 

(3.12) /A_„(a;) > e-^o.^Hn-m-i) ^ 
For the upper bound part, from 6 , we have 

(3.13) /A„,„(a;)< ^"''" e-i^a;^^"-'"-^). 

^m — l,n+l 



From (2.2), we have 



if™-i,„+i r(f)r(ii-f±i)r(i^) 
r(f)r(n-m + i)' 

Substitute (3.14) into (3.13) and (3.12), we get (3.10) and (3.11) . □ 

Similar to the real case, in the following lemma, we give uppe£ and lower bounds 
for the probability density function of the smallest eigenvalue Xmin of a complex 
Wishart matrix. These bounds can be proved using the same techniques used in the 
real case. Therefore, we omit the proof and only give the result here. 

Lemma 3.4. Let f~ (x) denotes the probability density function of the smallest 

eigenvalue ofWm,n, then f~ (x) satisfies: 

(3.15) Z„,„e-^^a;"-™ < /-^^^ {x) < L„,„e-5-a;"-™, 
where 

^^iR^ 7 r(n + i) 

(3.16) Lm, 



2"-™+ir(m)r(n - m + l)r(?i - m + 2) ' 
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4. The upper bounds for the distribution tails. In this section, we will 

derive the upper bounds for the tails of the condition rniniber distributions of ran- 
dom rectangular matrices whose elements are independent and identically distributed 
standard normal random variables. Our main results are Theorem 4.5 for real random 
matrices, and Theorem 4.6 for complex random matrices. 

Lemma 4.1. For any ^ > 0, x > 0, and n > m > 2, the largest eigenvalue Xmax 
and the smallest eigenvalue Xmin of Wm,n satisfy 

P (hn^ > A„,„ < ^\ < 1 / Any-'"+^ 

V ^min ' ~ ) r(n -m + 2)\ X ) 

Proof. From the upper bound for the probability density function of Xmin in 
Lemma 3.2, we have 

Xmax ^ 2 \ , A^n\ „ / , , A^n 

— ^ X , Amin _ 

Amin X~ J 

Jo 

<Lm,n ti^^'-'^-^Ut 

Jo 

r(l^) 1 fAn 

r (iii) (2.) "T"*"^ r(n -m + 2) 

Since m < n, by applying (2.6) repeatedly, we can prove 
Therefore, we have 



m+l 



Xmax ^ 2 ^ ^ ^^^\ ^ 1 / An\ 
> X , Amin S TT' < TT; "^TT I 



T{n-m + 2) \ X J 



n— m+1 



□ 

Similar to real random matrices, for complex random matrices, we have the fol- 
lowing Lemma 4.2. Lemma 4.2 can be proved using the same techniques as Lemma 
4.1, so we will omit the proof and only give the result. 

Lemma 4.2. For any A ^ 0^ x (ifid n ^ m ^ 2, the Icivgest eigenvalue Xmax 
and the smallest eigenvalue Xmin of Wm,n satisfy 

^(Xmax .r A^n\ . 1 



X , Xmin ^ o I 



\Xmin - J r(n-m + 2)H 2x^ 

The proof of the following Lemma 4.3 is based on the upper bound for the joint 
probability density function of Xmax and Xmin in Lemma 3.1 and the upper bound of 
the incomplete Gamma function in Lemma 2.6. 

Lemma 4.3. For any A > 2.32, x > 0, and n > m > 2, the largest eigenvalue 
Xmax and the smallest eigenvalue Xmin of Wm,n satisfy 

" I ^ > X , Xmin > I < 0.017- 



r(n-m-|-2) V X 
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Proof. From the upper bound for the joint probability density function of X^ax 
and Xmin in Lemma 3.1, we have 

p > A„,„ > r r h^^^,,^,^{s,t)dsdt 

< / / C„„e-5*t5("-'»-i)e-^«s5("+"'-3)dsdt. 
Taking the transform u = tx^ , we have 



(/: 



According to Lemma 2.6, with k = 4,if u > 2{n + m — 3), then 



Since A > 2.32 and n>m, hence, u > A^n > 2(n + m — 3). Therefore, we have 



X n-m+1 „oo 



Since A > 2.32, so A^n > 4(n — 2). Apply Lemma 2.6 again, we have 



P ( ^ > A„„ > ^ ) < 16C™,„e-^-^^M2»-4n"-2 



r(m - l)r(n - TO + 1) Vx> 

^ ■ - r(TO-i)r(n-TO + 2) \x) 

Note that, for any 2 < m < n, it can be proved that 



Substitute (4.2) into (4.1), we have 



P 



Xmax ^ 2 X ^ ^\ ^ 4e(^i"-^^-+i)" 1 /nN»-™+i 



,Ami„ ' a;^ / y/4nA'^ T{n-m + 2) Kx^ 

Since A > 2.32, therefore, we have 

g(21nA-^+l)n ^ ^_ 
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Therefore, when A > 2.32, we have 



mm 



Xmin ' x'^ J y/47TA'^T{n-ni + 2) \x 

< 0.017 



1 rAn^ "-™+' 



r(n — m + 2) 
□ 

Similar to real random matrices, for complex random matrices, we have the fol- 
lowing Lemma 4.4. Lemma 4.4 can be proved using the same techniques as Lemma 
4.3, so we will omit the proof and only give the result. 

Lemma 4.4. For any A > 3.2735, x >_0, and n > m > 2, the largest eigenvalue 
Xmax cind the smallest eigenvalue Xmin of Wm.n satisfy 

/Vmn.T tT I\ \l \ „ „ 1 I I\ 



P ^Jl^ > x\\„,„. > ^ < 0.0016 



A . ' ™" 2;2 / r(n-m + 2)2 V 2x 

We are now prepared to prove our first main result about the condition numbers 
of real random matrices whose elements are independent and identically distributed 
standard normal random variables. 

Theorem 4.5. For any n > m > 2 and x > n — m + 1, the 2-norm condition 
number of Gmxn satisfies 

,«) p( > < ' 



n/{n — m + l) J \^ \x 

where C < 6.414 is a universal positive constant independent of m, n, and x. 

Proof. For any L > 0, inspired by [2], we first break down P{K2{Grnxn) > into 
two parts. 

P{^2iG^xn)>x)^p(^>x' 

= P T > X%X,nin < ) + P\ T > X ,Xmin > 

\ ^niin X J \ A^nin X 

Let L = 2.32, then based on Lemma 4.1 and Lemma 4.3, we can get 

1 fL X^^^+i 



-0.017- 



-1 / r \ n — m+1 

1 / Ln ^ 



r(n — m + 2) \ X 

1 

< 



1 / 1.017Ln ^ 



r(n-m + 2) 
Note that, from Lemma 2.7, we have 

r(7i - m + 2) > V27r(n-m + l)(n - m + ly-m+i^-in-m+i) _ 
Therefore, we have 

•1.017e£ » 



P{l^2{Gmxn) > x) < 



^/27r(n - m + 1) 



n— m+1 
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Therefore 



n/{n-m + l) J ^1-K(n - m + 1) \ x 

1 /6.414^"-"+' 

< 



Let C = 6.414, then we get (4.3). □ 
Remark: 

1. The upper bound in Theorem 4.5 is for arbitrary n > m > 2 and a; > n— m+1. 
For some special case of m and n, more precise upper bound can be obtained. For 
example, for the special case of real random 2 x n matrices, based on the exact 
probability density function of n^iGi-Kn) in [5], we can get 

2x \"-' /2^""' 



P(«2(G2x„)>x)-(^^^) <(- 

2. For the special case of real random m x m matrices, where m > 3, it has 
been proved in [2j that 

G' 

(4.4) P{K2{Gmxrn) > m.x) < 

X 

where G' < 5.60 is a universal positive constant independent of x and m. 
In Theorem 4.5, if we take m = n, then we have 

T,t tr^ \ A 2.60 

^^(K2(G™xm) > m.x) < , 

X 

which is consistent with (4.4) except that we improved the upper bound for the 
constant G' from 5.60 to 2.60. From the following (4.5), we know that the constant 
G' in (4.4) actually must at least be 2. 

3. For the special case of large real random mx m matrices, it has been proved 
in [5] that 

lim P < X 

m^oo Y 771 

Therefore, we have 

(4.5) lim p( ^'^^"^^^K x)=l-e-i-^^- 

m— ►oo \ m J X 

as a; — > oo. Hence, the smallest possible universal constant G in Theorem 4.5 must be 
no smaller than 2\/27r. Therefore, the universal constant G in Theorem 4.5 actually 
must satisfy 

(4.6) G > 2%/2^ w 5.013. 

Similar to real random matrices, for complex random matrices, we have the follow- 
ing Theorem 4.6. Theorem 4.6 can be proved using the same techniques as Theorem 
4.5, so we will omit the proof and only give the result. 

Theorem 4.6. For any n > m > 2 and x > n — m + I, the 2-norm condition 
number of Gmxn satisfies 
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where C < 6.298 is a universal positive constant independent of x, m, and n. 

5. The lower bounds for the distribution tails. In this section, we will 
prove the lower bounds for the tails of the condition number distributions of random 
rectangular matrices whose elements are independent and identically distributed stan- 
dard normal random variables. Our main results are Theorem 5.5 for real random 
matrices, and Theorem 5.6 for complex random matrices. 

Lemma 5.1. For any B > 0, x > 0, and n > m > 2, the smallest eigenvalue 
^min ofWm,n Satisfies 

! / 1 \ n—m+l 

P < > y— e-^ r(n-m + 2) ) 



Proof. From the lower bound for the probability density function of Xmin in 
Lemma 3.3, we have 

P {Xm < ^) = 1^ f{Xm)dXm 



Note that 



and 



Therefore 



i: 



> Lm,ne 2x2 / Xm dXm 

Jo 



= e 2x 



n ~ m + 1 \x 



r(f)( 



n\^^-^ — r(n — m + 2) \ X 

2 / 



1 + 2 



n + 1 

e 2 . 



-r(-)<v^(-) e-^+-. 



r(f)(t) 



m— l*jn— m+1 



= e 2 6m 



/ n"+i(l + l/n)"+i 



(n + l)m™-in"-™+i 



> e ^ 



+l__L_ I ne 

n + l' 
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Since 2 < m < n, therefore, we have 



r(f)(i)" 

Therefore, we have 



3 



□ 

Similar to real random matrices, wc have the following Lemma 5.2 for complex 
random matrices. Lemma 5.2 can be proved using the same techniques as Lemma 
5.1, so we will omit the proof and only give the result. 

_ Lemnia 5.2. For any B > 0, x > 0, and 2 < m < n, the smallest eigenvalue 
^min ofWm,n Satisfies 



r(n-m + 2)2 V 2x2 



The proof of the following Lemma 5.3 is based on the upper bound of the joint 

probability density function of Xmax and Xmin in Lemma 3.1 and the upper bound of 
the incomplete Gamma function in Lemma 2.5. 

Lemma 5.3. For any B < e~^'^, x > 0, and 2 < m < n, the largest eigenvalue 
^max o-nd the smallest eigenvalue Xmin of Wm,n satisfy 

„ , 1 / 1 \ n—m+l 

B^n Xma. ^ i\ ^ IIB"-^ 1 / e—-Bn\ 



4\/4^ r(n-m + 2) \ x J 

Proof From the upper bound for the joint probability density function of A„ 
and Xmin in Lemma 3.1, we have 

p(Xmin<^,J^<X^)= r fx^a.,X^.n{s,t)dsdt 



< Cm,n I '^ l e-5*t5("-'»-l)e-5«s5("+'»-3)rfsrft. 

Jo Jo 

Taking the transform u = tx^ , we have 

P { Xmin <^,^<X^]= Cm,n ( e-^t.^^""™"!) 

According to Lemma 2.5, if u < n + m — 3, then 







/ 

Jo 
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Therefore, when B < e we have 

/ R2ri \ \ / 1 \ "-'"+1 fB'^n 

P ( Xmin <^,^<x']<Cm,u -] / e-^-iV-'du 



^mzn — 2 ' \ — : — I — : ^ I 



'mm / \^ / Jo 

n— m+1 pB'^n 



x) Jo 



Since B < e so B^n < 2(n — 1). Applying Lemma 2.5 again, we have 
Bhi \ 



n— m+1 



g--V5n+m-l„m-l / Bn\ 



4r(m - l)r(n - m + 1) V a; y 

Prom (4.2), we have 



< 



r(m-i) Vi^' 

Therefore, we have 

-P A™„ < — r-, <x\< 



' Amj„ y 4V47rr(n -m+1) V 2; 

^ S™"in(n-TO+ l)ei"e-^S" 



4\/47r 

/ 1 \ n— m+1 

1 / e~'sBn \ 



T{n-m + 2) [ x I 

When B < e"^ '', for all n > m > 2, we have 

n{n-m+ I)e2"e-'^B" < 11. 
Therefore,when B < e"^ '', we have 

/ 1 \ n—m+l 

V >'min ) 4V47r r(n-m + 2) \^ x j 

□ 

Similar to real random matrices, wc have the following Lemma 5.4 for complex 
random matrices. Lemma 5.4 can be proved using the same techniques as Lemma 
5.3, so wc will omit the proof and only give the result. 

_ Lemma 5.4. For any B"^ < e~^-^, x >J}, and 2 < m < n, the largest eigenvalue 
AmoK o,nd the smallest eigenvalue \min of Wm,n satisfy 

/ 7-» T \ 1 / —1 n9 9\ n—m-\-l 



P 1 Xmin < < a;2 I < 0.0352 



^"A™„" / " r(n-m + 2)H 2x^ 
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We are now prepared to derive the lower bounds for the tails of the condition num- 
ber distributions of random matrices whose elements are independent and identically 
distributed standard normal random variables 

Theorem 5.5. For any x > n — m + 1 and n > m > 2, the 2-norm, condition 
number ofGmxn satisfies 

^ ^ \n/{n-m + l) J ^/2^\x) 

where c > 0.245 is a universal positive constant independent of x,m, and n. 
Proof. For any positive constant H, we have 

P{K2{Gmxn) > x) = P ( ^ > 
\ Am 

„ , , H'^n Ai 9 

>P{Xm< -^,J^>X^ 
X Am, 



= ^^Am<^J-P^Am<^,-<x 
Let H = e"^ '', then based on Lemma 5.1 and Lemma 5.3, we have 

, / hzJ lliJ^^M 1 f e-iHnY~"^^^ 

PU > x)> \ \ — -e — — 

^ ^ I V 3 4\/4^ j T{n-m + 2) y x J 

From Lemma 2.7, we have 

r(n - m + 2) < V27r(n-m+l)(n - m + i)n-m+ig-(n-m+i)+ _ 
Note that, for 2 < m < n, we have 

Vn-m + 1 < 1.21"-™+!, 1^ < 1, 

12(n — m+1) 12 

Therefore, we have 

P{K2{Gm,n) > X) > \ \ —e ' ( ^ +^ 



3 4\/4^ / V2^ 

Since H = e^^'^, a; > 1, and 2 < to < n, so we have 



'2ei H^mn llff™-! , 

— e e-T5 > 0.99. 

3 4v/4^ 



Therefore, we have 

0.99 / 0.248 " ^ 



P{K2{Gm,n) > x) > 



n— m+1 



\/27r V X 

> 



I /0.245 ^ 

' n— m+1 



\/27r V ^ 
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Therefore 

K2{G^,n) \ 1 ^0.245^"-™+^ 

> a; > ' 



n/(n-m + l) / i/27r 

Let c = 0.245, then we get (5.1). □ 
Remark: 

1. The lower bound m Theorem 5.5 is for arbitrary n> m>2 and x > n—m+1. 
For some special case of m and n, more precise lower bound can be obtained. For 
example, for the special case of real random m x m matrices, where to > 3, it has 
been proved in [5] that 

Q 

P iK2{Gmxm) > TO . x) > -, 

X 

where c > 0.13 is a universal positive constant independent of x and m. 
In Theorem 5.5, however, if we take m = n, then we can only get 

P (K2[C'nixm) > m . X) > , 

X 

2. For the special case of real random 2 x n matrices, based on the exact prob- 
ability density function of K2(G2xn) in [5], we can get 



P{K2{G2xn) > X) = 



2x \"^^ /2^"-i 



1 



as a; "> cxD. Hence, the constant c in Theorem 5.5 is no larger than 2. Therefore, the 
constant c in Theorem 5.5 actually satisfies 

(5.2) 0.245 < c < 2. 

Similar to real random matrices, we have the following Theorem 5.6 for complex 
random matrices. Theorem 5.6 can be proved using the same techniques as Theorem 
5.5, so we will omit the proof and only give the result. 

Theorem 5.6. For any x > n — m + 1 and n > m > 2, the 2-norm condition 
number ofGmxn satisfies 



P — > X \ > 

\ n/ (n — TO + 1) / 



2tt \xJ 



where c > 0.319 is a universal positive constant independent of x,m, and n. 

6. The upper bounds for the expected logarithms. For square Gaus- 
sian random matrix Gnxn, in ^Hj, Smale asked for _E(log K2(G'„xn))- Similarly, 
for rectangular Gaussian random matrix Gmxm it is also interesting to investigate 
E{logK2{Gmxn))- In this section, we will derive upper bounds for i?(log K2(G'mxTi)) 
and E(\og'K2{Gmxn))- Our main results are Theorem 6.1 and Theorem 6.2. 

Theorem 6.1. For any n > m > 2, the 2-norm condition number of Gmxn 
satisfies 

(6.1) i;(logAt2(G™xn)) <log — + 2.258. 

71 — TO + 1 
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Proof. Let /^(a;) be the probability density function of K2(G'mxn)j then 

\ n— m+1 / ^ \ n— m+1 / 

< / 6 111 '' » ^«(^)'^^ 

6.414 2^ 



From Theorem 4.3, we have 

^'(K2(Gmxn) > 2^) < 

Therefore, we have 



1 /6 414- " \ n-m+i 



n — m+1 



\/27r V ^ 



/^2(G™x^\ ^ 1 ^ 6.414;^ ^"^"'"- 1 

1 



(n - m + l)V27r 
< 0.399. 



Therefore, we have 



£;iog(K2(G',„xn)) < log ^^^—- + log 6.414 + 0.399 

n — m + 1 

<log + 2.258. 

n — m + 1 

□ 

Remark: 

1. For the special case of real random m x m matrices, from the results in jl2j . 
we can get 

(6.2) £;iog(K2(G,nx™)) < logm + « 2.54. 

In Theorem 6.1, if we take m — n, then we have 

£;iog(K2(G,„x„)) < logn + 2.258. 

which is a slightly improved version of (6.2). 

2. The upper bound in Theorem 6.1 is for arbitrary n > m > 2. For some 
special case of m and n or large m and n, more precise results exist: 

For the special case of real random 2 x n matrices, it was shown in f6] that 

£;iog(«2(G2x„)) = 
For real random m x m matrices, it has been proved in [6] that 
£;iog(K2(G )) = logm + c + o(l) 
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as m — > OO, where c « 1.537. 

For rectangular matrix Gm„xm if lini„^oo fnn/n — y and < y < 1, then it has been 
proved in that 

E log(«2 (G„„ x„)) = log + o(l) 

as n — > oo 

Similar to real random matrices, we have the following Theorem 6.2 for complex 
random matrices. Theorem 6.2 can be proved using the same techniques as Theorem 
6.1, so we will omit the proof and only give the result. 

Theorem 6.2. For any n > m > 2, the 2-norm condition number of Gmxn 
satisfies 

— n 
S(logK2(G™xn)) <log — + 2.240. 

71 — TO + 1 
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